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<^ ■ Abstract 



The post-enrolment course timetabling (PE-CTT) is one of the most studied 
timetabling problems, for which many instances and results are available. In 
this work we design a metaheuristic approach based on Simulated Annealing 
to solve the PE-CTT. We consider all the different variants of the problem 
that have been proposed in the literature and we perform a comprehensive 
experimental analysis on all the public instances available. The outcome is 
that our solver, properly engineered and tuned, performs very well on all 
cases, providing the new best known results on many instances and state-of- 
■ the-art values for the others. 
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1. Introduction 



Timetabling problems are widespread in many human activities and their 
solution is a hard optimisation task that can be profitably tackled by Opera- 
tions Research methods. Educational timetabling is a sub-field of timetabling 
that considers the scheduling of meetings between teachers and students. 

A large number of variants of educational timetabling problems have been 
proposed in the literature, which differ from each other based on the type of 
institution involved (university, school, or other), the type of meeting (course 
lectures, exams, seminars, . . . ), and the constraints imposed. 

The university course timetabling (CTT) problem is one of the most stud- 
ied educational timetabling problems and consists in scheduling a sequence 
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of events or lectures of university courses in a prefixed period of time (typi- 
cally a week), satisfying a set of various constraints on rooms and students. 
Many formulations have been proposed for the CTT problem over the years. 
Indeed, it is impossible to write a single problem formulation that suits all 
cases since every institution has its own rules, features, costs, and fixations. 

Nevertheless, two formulations have recently received more attention than 
others, mai nly thanks to th e two timetabling competitions, ITC 2002 and 
ITC 2007 (IMcCollum et all 120101 ). which have used them as competition 
ground. These are the so-called curriculum-based course timetabling (CB- 
CTT) and post- enrolment course timetabling (PE-CTT). The main difference 
between the two formulations is that in the CB-CTT all constraints and 
objectives are related to the concept of curriculum, which is a set of courses 
that form the complete workload for a set of students. On the contrary, in 
PE-CTT this concept is absent and the constraints and objectives are based 
on the student enrolments to the courses. 

In this work we focus on the PE-CTT problem and we design a single-step 
metaheuristic approach based on Simulated Annealing (SA), working on a 
composite neighbourhood composed of moves that reschedule one event or 
swap two events. The solver is able to deal with all the different variants of 
the PE-CTT problem proposed in the literature. 

We experiment our solver on all the instances that have been made pub- 
licly available (up to our knowledge). The outcome of our experimental 
analysis is that our general solver, properly engineered and tuned, is able to 
outperform most of the solvers specifically designed and tuned for a single 
specific formulation and/or a specific set of instance. 



2. Problem Definition 

Over the years, different versions of the PE-CTT problem have been 
defined. We first illustrate (Section 12. ip the most general versi on, which is 



the on e that has been used for ITC 2007 and is described by iLewis et al 



(120071 ) . The other versions are obtained from this one by removing some of 
the features, and they are described in Section 12.21 along with a presentation 
of the available instances. 



2.1. General Definition of PE-CTT 

In the PE-CTT problem it is given a set £ = {1, ... , E} of events, a set 
T = {1, . . . , T} of timeslots, and a set 1Z = {1, . . . , R} of rooms. It is also 
defined a set of days V = {1, . . . ,-D}, such that each timeslot belongs to one 
day and each day is composed by T/D timeslots. 
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It is also given a set of students S and an enrolment relation Ai C £ x 5, 
such that (e, s) G .M if student s attends event e. 

Furthermore, it is given a set of features J 7 that may be available in 
rooms and are required by events. More precisely, we are given two relations 
$r C TZ x T and C £ x T such that (r, /) G if room r has feature / 
and (e, /) G $e if event e requires feature /, respectively. Each room r ElZ 
has a fixed capacity C r , expressed in terms of seats for students. 

In addition, it is defined a precedence relation II C £ x £, such that if 
(ei,e2) G II, events t\ and e2 must be scheduled in timeslots t\ and £2 such 
that £1 < £2- 

Finally, there is an availability relation A C £ x T, stating that event e 
can be scheduled in timeslot £ only if (e, £) G *4. 

The (hard) constraints of the problem are the following ones: 

HI. Conflicts: Events that share common students cannot be scheduled in 
the same timeslot. 

H2. Compatibility: An event cannot be allocated in a room that is missing 
one of the features needed by the event, or in a room whose capacity is 
less than the number of students attending the event. 

H3. Occupancy: No more than one event per room per timeslot is allowed. 

H4. Availability: Timeslots must be assigned to events according to the avail- 
ability relation A. 

H5. Precedences: Timeslots must be assigned to events according to the 
precedence relation n. 

Since reaching feasibility could be non trivial for some instances, the def- 
inition given fo r ITC 2007 include s the distinction between valid and feasible 



timetables (see lLewis et all 120071 ). In a valid timetable all hard constraints 
must be satisfied, but it is allowed to leave some events unscheduled (i.e., 
they have no timeslot assigned). A feasible timetable is a valid one in which 
all events are scheduled. 

The prescription of the ITC 2007 rules require all solutions to be valid, 
but they do allow also infeasible solutions. In formal terms, this means that 
the problem consists in finding an assignment f-J-Tx^U {(£5, r$)}, where 
t$ and r$ are a dummy timeslot and a dummy room. The assignment of an 
event to these special entities identifies the unscheduled events. In addition, 
we introduce a new hard constraint type, that accounts for the unscheduled 
events, which can be violated to some extent: 

H6. Unscheduled Events: Events cannot be unscheduled. 
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The (integer- valued) objective function is the sum of the following soft 
constraints. Each violation of any of the three kinds accounts as one point 
in the objective function. 

51. Late Events: A student should not attend an event in the last timeslot 
of a day. For each event in the last timeslot, we compute the sum of the 
number of students that have to attend it. 

52. Consecutive Events: A student should not attend more than two consecu- 
tive events in a day (i.e., the last timeslot of a day and the first one of the 
following day are not considered as consecutive). For each day and for 
each student, we compute the sum of the consecutive events subsequent 
to the second. For instance, if 3 students have to attend 4 consecutive 
events in a day, the penalty is 3 • (4 — 2) = 6. 

53. Isolated Events: A student should not attend only one single event in the 
whole day. For each day, we sum the number of students that have to 
attend isolated events. 

In conclusion, the quality of the solution is evaluated with an evaluation 
function that is composed by two measures: the distance to feasibility (H6) 
and the objective function (SI + S2 + S3). The distance to feasibility is 
computed as the sum of the numbers of students that require unscheduled 
events. 

The evaluation function is hierarchical, in the sense that valid solutions 
with the lower distance to feasibility are better solution. If two valid solutions 
have the same distance to feasibility, then the solution with the minimum 
value of the objective function is preferred. 

2.2. Problem Variants and Available Instances for PE-CTT 



The problem formulation presented above is the one defined by lLewis et al. 



(120071 1 and used in the ITC 2007. Two other versions have been considered 
in the literature, which are obtained from the above one by removing some 
of the constraints. 

In particular, the fir st one is the original for mulation, proposed by the 



Metaheuristics Network (IRossi-Doria et al.l . 120031 1 and used for the ITC 2002. 



This formulation does not consider Availability and Precedences. In addition, 
since for the ITC 2002 instances the feasibility was easy to be obtained for 
all instances, the possibility to leave some events unscheduled was not taken 
into account. 



The other formulation has been proposed by iLewis and Paechterl (120051 ) 
and is a further simplification, as it does not include Availability and Prece 
dences and it discards all soft constraints. Differently from the previous for 
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Formulation HI H2 H3 H4 H5 H6 SI S2 S3 

Full (ITC 2007) VVVVVVVVV 
Original (ITC 2002) V V V V V V 

Hard-Only y/ \/ \j — — yj — — — 



Table 1: PE-CTT formulations. 



Instance Family Formulation 


# Instances Year 


ITC 2007 Full 


24 2007 
GO 2005 


http : //www . cs . qub . ac . uk/ itc2007 


Lewis & Paechter Hard-Only 


http : / / www . soc . napier . ac . uk/~benp/ centre/t imetabling/harder instances . ht n 


ITC 2002 Original 


20 2002 


|http://www. idsia. ch/Files/ttcomp2002 


Metaheuristics Network Original 


12 2001 


http : //iridia . ulb . ac . be/supp/IridiaSupp2002-001 





Table 2: Available instances for PE-CTT. 



mulation, however, it considers the possibility of having unscheduled events. 
The formulations considered are summarised in Table [TJ 

Four sets of instances are publicly available and have been used in the 
experimental analyses reported in the scientific literature so far. Table [2] 
lists for each set of instances the origin, the web site from which they can 
be downloaded, the formulation considered, the number of instances that 
compose the data set, and the year of publication. 

All instances are artificial, as they are created by a random generator, 
based on realistic bounds for the problem features. For all of them, the set 
of timeslots is fixed to T = 45, split in 5 days D = 5 of 9 timeslots each, 
such that timeslots {1, . . . , 9} belong to day 1, timeslots {10, . . . , 18} belong 
to day 2, and so on. 

Each instance is available in a single text-only file (for the sake of brevity, 
we do not report the format here). Two different file formats are used: one for 
the Full formulation, which includes Availability and Precedences, and the 
other for the Original and Hard- Only formulations, without them. In 
addition, the proposers have released a validator for both the Original and 
the Full formulations. We have used it for certifying the solution quality of 
all the results we have found in the experimental phase. 

This means that for example the instances of iLewis and Paechterl (120051 ) 
could be used also for the Original formulation. However, we consider only 
the pairs Instance/Formulation that have been investigated in the past, so 
that we can compare with previous work. 
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3. Related Work 



In the last forty years, starting with iGotliebl ( 119631 ) . many papers related 
to educational timetabling have been published and several applications have 
been developed and employed in practise. In addit ion, many re s earch surveys 
have been published , going fromlde Werral (119851) . t olSchaerJ (ll999l) . to the 
most recent ones by Burke and Petrovic ( 2002 ) and Lewis ( 20081 ). We refer 
to them for an introduction to educational timetabling. 

With specific regard to cou rse timetabling, th e most seminal works on 
course timetabling are those by iHerta (119911 . Il992l ). who uses a Tabu Search 
approach to s olve t wo different versions of the problem. More recently, 



Murray et al.l (120071 ) tackle a very complex formulation of the problem and 



solve it by decomposition and constraint-based local search. 

However, most of the recent work on course timetabling, besides the 
one on PE-CTT, has focu sed on the other "s tandard" formulation, namely 
CB-CTT. To this regard, iLu and Had (l2009h solve the CB-CTT pro blem 



by Tabu Search on a large neighbourhood. lLach and Liibbeckd (j201lf ) and 



Burke et al.l (120101 ) both use a IP a pproach and find seve ral lower bounds 



along with a few optimal solutions. lHao and Benlid ( 120111 ) use a decompo- 
sit ion approach to improve o n the lower bo unds obtained with the model 
of lLach and Liibbeckd ( 120111 ). iMullerl (120091 ) uses a multi-step local search 
approach to find g ood solutions of the problem. Finally, our research group 



(IBellio et al.l . 1201 if ) has proposed a hybrid Tabu Search/Simulated Annealing 



approach for this problem. 

The initial work on PE-CTT has bee n carried out inside the Metaheuris- 
tics Network by iRossi-Doria et al.l (120031 ) who compare several metaheuristic 
techniques for the Original formulation on the set of in stances specifically 



design ed for their study. That work has been extended by IChiarandini et al. 



(120061 ) that apply the same techniques, suitably refined and tuned, to the 
instances defined for the ITC 2002. 

The same formulation has been tackled by IKostuchl (120051) using a multi- 
stage metaheuristic approach. Both IKostuchl and IChiarandini et al.l consider 
a search space composed by assignments of events to timeslots only, leaving 
the rooms unassigned. The room assignment is performed by a specialised 
sub-solver that applies a m atching algor it hm. F inall y, the ITC 2002 instances 



have been tested also by iBurke et al.l (120031 ) and iDi Gaspero and Schaerl 



(120061 ). who also used local search based tech niques. 



Moving the Full ITC 2007 formulation, IChiarandini et al.l (120081) pro- 



pose a solver, built on the previous work for ITC 2002 (IChiarandini et al. 



2006h . which consists of several heuristic modules in a two phase solution pro- 



cess (dealing with hard and soft constraints, respectively). The modules have 
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been assembled an d tuned using the au t omated algorithm configuration pro - 
cedure ParamlLS fjHutter et all 120091 ). IVan den Broek and Hurkensl ( 120101 ) 
design a deterministic heuristic approach that builds a LP solution using 
column gene ration and then tries to improve it by solving ILP subproblems. 



Lewis! (120101 ) employs a three stages strategy in which a constructive phase 
is followed by two separate phases of Simulated Annealing. The idea be- 
hind this method is to arrange constraints corresponding to different levels 
of i mportance in the different phases of the solution process. 

Mullerl ( 120091 ) applies a constraint-based framework incorporating a series 
of algorithms based on local search techniques, t hat operates over feasible 



(but not necessarily complete) solutions. Finally, ICambazard et al.l ( 120 lOl ) 



proposes both a constraint-based technique and a multi-stage local search 
one. This latter method has been the winner of the PE-CTT track of the 
ITC 2007. 

A few authors considered the Ha rd- Only formulatio n and the c orre- 
sponding instances. The first works by iLewis and Paechterl (120051. 120071) use 



an evo lutionary algorithms to tackle the problem. Subsequently, iTuga et al. 



(120071 ) use a graph-based heuristic to construct a feasible solution of the re- 
laxed problem (where constraint H2 is partially relaxed) and the n apply a 



SA-ap proach relying on a Kempe chains neighbourhood. Finally, iLiu et al. 



(1201 ll ) propose a clique-based heuristic that tries to identify cliques as the 
set of events that can be scheduled in the same timeslot. 



4. Local Search for Post-Enrolment Course Timetabling 

We describe our local search technique in six stages by highlighting the 
different components of our solution method. Namely these components 
are: preprocessing and constraint reformulation, search space, initial solu- 
tion, neighbourhood relations, cost function, and the Simulated Annealing 
metaheuristic. 



4-1. Preprocessing and constraint reformulation 

By a careful analysis of the features and the constraints of the problem 
it is possible to identify some preliminary preprocessing and reformulation 
steps that can significantly improve the efficiency of the local search phase. 
This stage is composed by five steps. The first thre e steps have alr eady been 



proposed and employed in previous works (see, e.g. iKostuchl . 120051 ). Instead, 
the remaining two steps are our original ideas and they have a substantial 
impact on the search strategy of our solver. 

1. Creation of auxiliary matrices: According to the features held by the 
rooms, the room capacities, and the features requested by the events, 
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we create a Boolean-valued event-room compatibility matrix G#, which 
states whether a room is suitable for an event. The data about features 
and capacities can then be discarded and replaced completely by the 
Qr matrix. 

Similarly, according to the student enrolment data we create a sym- 
metric Boolean- valued event- event conflict matrix Oe, which accounts 
for the presence of common students between pair of events. 

2. Propagation of precedences: Given the precedence relation IT, we per- 

form a preliminary constraint propagation in order to restrict the avail- 
ability for the events. For any pair of events e\ and e 2 such that 
(ei,e 2 ) G II, we mark as unavailable period T for e±, and period 1 
for e-i- Pursuing further this idea, we consider all chains of events (also 
longer than two) in the graph obtained by the transitive closure of the 
precedence relation. Based on this process (known as arc-consistency in 
the constraint programming community), we determine for each event 
e a minimum and a maximum assignable timeslot. The values outside 
this interval are considered unavailable for e, and thus removed from 
the availability relation A. 

3. Identification of 1-room events: Looking at the G^ matrix, it is pos- 

sible to identify events that are compatible only with a single room. 
We call these events 1-room events. Obviously, two 1-room events that 
share the same compatible room r cannot be scheduled in the same 
timeslot. We thus update the G^ matrix adding these new conflicts. 

4. Identification of all-room events: A further look at the Qr matrix 

allows us to identify also the events that are compatible with all the 
rooms. We call these events all-room events. 

For this kind of events it is not necessary to assign a room during search, 
and the actual room can be assigned in a simple post-processing phase. 
Therefore, these events are always assigned to the dummy room r$. 
However, through the search it is still necessary to guarantee that the 
number of events assigned to each timeslot does not exceed the number 
of rooms R. 

5. Sorting rooms by the number of compatible events: In this step, 

we count for each room the number of events that are compatible with it 
(all-room events are not considered in this phase). This value represents 
a sort of "attractiveness" of the room. We create a list of rooms sorted 
in ascending order of attractiveness. 



S 



This list will be used in the search in order to assign rooms in such 
a way to leave during search the most attractive rooms available for 
further events to be added. 

4-2. Search Space 

As already mentioned, the solution space is composed by all the assign- 
ments of timeslots and rooms to events extended with the pair composed by 
dummy timeslot and the dummy room: £ — > (T x 1Z U {{ts,fs)})- 

The search space employed by our algorithm is the solution space itself, 
with some restrictions. First, only available timeslots and compatible rooms 
can be assigned to each event. In addition, assignments are included in the 
search space only if no pair of events are assigned to the same timeslot and 
room, and the total number of events assigned to a timeslot is less than or 
equal to the number of rooms. Summarising, all assignments in the search 
space do not violate the constraints Compatibility, Availability, and Occupancy. 

On the other hand, Conflicts, Precedences, and Unscheduled can be vio- 
lated, and thus they are included in the cost function. 

Finally, in the search space all-room events are always assigned to the 
dummy room rs, and actual rooms will be assigned during the post-processing 
phase. 

4-3. Initial Solution 

For the construction of the initial solution, we propose two different meth- 
ods. The first one, denoted by Iq , is a greedy procedure that assigns each 
event e to a random timeslot t, which is available for e and is not already 
assigned to R events. 

If a room r compatible with e is free in t, the pair (t,r) is assigned to e, 
otherwise the event is assigned to (ts,rs). Compatible rooms are visited in 
order of ascending attractiveness. 

The second method, denoted by Ix, is based on the same idea but it tries 
to leave unscheduled as few events as possible. It proceeds in the same way, 
but when no room is available in t for e, I\ draws a new random timeslot. 
However, being a greedy procedure, it might happen in a given stage that 
there is no room compatible with e in any timeslot. In order to avoid an 
infinite loop in such a situation, we stop the procedure after a finite number 
of draws and assigns e to (ts,rg). For example, for the ITC 2007 instances, 
the number of unscheduled events of a state generated with Ii is most of the 
times 0, and occasionally it is 1 or 2. On the contrary, for Iq up to 25% of 
the events might be left unscheduled in the most difficult instances. 
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4-4- Neighbourhood relations 

Two different neighbourhood relations are considered in this work: 

MoveEvent (ME): Move one event e G £ from its currently assigned times- 
lot to timeslot t G TU {ts}- The move ME(e,t) is admissible if t is 
available for e and there is a compatible free room r for e in 1 The 
pair (t, r) is assigned to e. 

SwapEvents (SE): Swap the timeslots ti,t 2 G TU {t$} assigned to two 
events ei,e 2 G £. The move SE(ei,e 2 ) is admissible if ti ^ t 2 and t± 
(resp. t 2 ) is available for e 2 (resp. ei) and there is a compatible free 
room ri (resp. r 2 ) for e 2 (resp. ei) in t\ (resp. t 2 ). The pair (t 2 ,r 2 ) is 
assigned to t\ and the pair (t 1; ri) is assigned to e 2 . 

For both neighbourhoods, rooms are explored in ascending order of at- 
tractiveness. For events in timeslot ts and for all-room events the only room 
considered compatible is r$. 

For the neighbourhood ME we also consider a restricted version that we 
call ME~. The move ME~(e,t) is admissible only if t ^ ts- Intuitively, ME~ 
excludes the moves that increase the number of unscheduled events in the 
current state. 

4-5. Cost Function 

The cost function that guides the search is a combination of the soft con- 
straint penalty and the violation of hard constraints. In detail, Compatibility, 
Occupancy, and Availability are always satisfied in the search space, whereas 
Conflicts, Precedences, and Unscheduled Events can be violated, and therefore 
they are included in the cost function. 

In case of violation of the Unscheduled Events constraint, the formulation 
prescribes to count the number of students that are enrolled in the event. 
Consequently, in order to have comparable values also for the other hard 
constraints components, in case of a violation of the Conflicts and Precedences 
constraints we count the minimum between the number of students of the 
two events involved. However, for the purpose of having at the end of the run 
only possible violations of the Unscheduled Events component (as required), 
in the last few iterations of the search the cost of Conflicts and Precedences 
is doubled. This proved experimentally to be sufficient to ensure that there 
are no violations of a type different from Unscheduled Events. 

In conclusion, the cost function F is the composition of two terms: the 
distance to feasibility, multiplied by a suitable high weight W, and the ob- 
jective function /. 
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Given that we make one single step and that the move acceptance is based 
on AF, the value of W is crucial of the performances of our solver. In fact, 
if W is too high the start temperature needs to be set to a very high value, 
which would result if a waste of time for the search. On the other hand, if 
W is too small it is possible that the solver follows trajectories that "prefer" 
infeasible solutions to feasible ones, if they have lower objective cost. In 
conclusion, W needs to be set experimentally, as discussed in Section 

4-6. Simulated Annealing 

Many versions of SA have been proposed in the l iterature (see, e.g., 



Kirkpatrick et all Il983l : lEglesd . Il990l : lAarts and Lenstral . 119971 ; iHoos and Stiitzk 



20051 ). The version used here is the one with probabilistic acceptance and 
geometric cooling. In detail, at each iteration of the search process a random 
neighbour is selected. The move is performed either if it is an improving one 
or according to an exponential time- decreasing probability. If the cost of the 
move is AF > 0, the move is accepted with probability e~ AF ^ T , where T is 
a time-decreasing parameter called temperature. At each temperature level 
a number A" of neighbours of the current solution is sampled and the new 
solution is accepted according the above mentioned probability distribution. 
The value of T is modified using a geometric schedule, i.e., Tj + i = (3 ■ 7$, in 
which the parameter /3 < 1 is called the cooling rate. The search starts at 
temperature T and stops when it reaches T min . 

Different settings of the parameters of SA would result in different running 
times. Instead, we want to compare them in a fair setting, giving to all of 
them the same amount of computational time. To this aim, we let the three 
parameters To, T m j n , and /3 vary and we fix A" in such a way to have exactly 
the same number of total iterations. Calling I the fixed total number of 
iterations, we compute A" from the following formula. 



AT = //lo g/3 (T /T min ) 

In this way, the total running time is approximately the same, for all 
combinations of parameters. 

We experiment with three solvers, that differ from each other based on 
the neighbourhood used and the initial solution procedure. The first solver 
we consider is SA using as neighbourhood the union of ME and SE, and 
as the initial state method Iq. We denote it as SA(Iq, ME © SE). Using a 
similar notation, the other two solvers are denoted by SA(I , ME~ ©SE) and 
^(Ji, ME" ©SE). 

Intuitively, the first one explores freely the full search space, composed 
also by unscheduled events. The second one starts with a state with un- 
scheduled events, but leads the search as much as possible in the direction 
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of feasible solutions. The third one focuses on the space in which all events 
are scheduled. 

The total number of iterations is set to / = 1.14 • 10 8 , which corresponds 
approximately to the time granted for ITC 2007 and which results in a run- 
ning time of about 300s on our PC, an Intel Core i7 @1.6 GHz PC (64 bit). 
We prefer to set the num ber of iteration s, rather than using a real timeout 
because, as advocated by I Johnson! (120021 ). the use of the timeout makes the 
experiments less reproducible. 

The softwa re is written in C++ languag e, it uses the framework Ea- 
SyLocal++ (IDi Gaspero and Schaeri 120031 ). and it is compiled using the 
GNU C/C++ compiler, v. 4.4.3, under Ubuntu Linux. 



5. Experimental Analysis 

For tuning the three solvers, we first select the parameters to be evaluated. 
To this regard, we decide to use T , (3, and p = T /T min , which turned out 
to provide a better selection of the configurations than using T m i n directly. 
Given that we use two different types of moves, namely ME (or ME~) and 
SE, we add an additional parameter, called sr (for swap rate) which is the 
probability of drawing a move of type SE. Finally, the parameter W needs 
to be set. 

5.1. Preliminary Screening 

In order to perform an effective tuning it is useful to have a screening 
based on preliminary experiments, that allows us to eliminate some of the 
five parameters and to focus on the most important ones. 

Preliminary experiments show that /3 is not significant. This is not sur- 
prising, because in our setting N is a function of the other parameters, and 
therefore /3 only determines the entity of the single step in the temperature 
and not the actual slope of the cooling trajectory, which is determined by p. 
We therefore set (3 to the fixed value 0.9999. 

Preliminary experiments show also that sr is not significant, as long as it 
is set within the range [0.1,0.5]. Consequently, we fixed sr to the value 0.4, 
which provided marginally better results. 

Regarding W, it turned out that the value W = 1 is big enough to ensure 
that the solver prefers feasible solutions to infeasible ones. Therefore this 
parameter is set to 1 for all experiments. This surprising finding is explained 
by the observation that a hard violations has a cost equal the number of 
students involved, whereas only a fraction of the students involved in the 
move contributes to the soft constraints. 
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5.2. Experimental Design and Tuning 

For the remaining two parameters (To and p), we have to select the config- 
urations to be tested. Instead of using a classical full factorial design, which 
consists in a regular sampling of the range for each parameter and testing all 
combination s, we resort to the Nearly Orthogonal Latin Hypercubes (NOLH) 
proposed by ICioppa and Lucasl (120071 ) , that allow us to fill the space using 
much less configurations. To generat e the actual co nfigurations we use the 
NOLH spreadsheet made available by I Sanchez using the design with 

33 points, within the ranges T G [1, 100] and p G [10, 1000]. 

For the comparison of the 33 configurations we resort to F-Race (IBirattari . 



20051 ). which is a sequential testing procedure that uses the Friedman two- 



way analysis of variance by ranks to decide upon the elimination of inferior 
candidates. At each stage, a new instance is selected, all remaining configura- 
tions run on it, and weaker configurations are discarded if enough statistical 
evidence has arisen against them. We use the canonical value 0.05 as signifi- 
cance level in the tests. The transformation of results in ranks prescribed in 
F-Race guarantees that in the statistical procedure the aggregation of results 
over the instances is not influenced by the differences in the scale of the cost 
function values that depends on the instance at hand. 

Considering that each set of instances has different features and they refer 
to different problem formulations (see Table [2]), we decide to tune separately 
the parameters for each instance family. A tuning process directed to a 
general and unique parameter setting is also possible and it leads to only 
slightly inferior results, proving that the algorithm is robust enough. 

For each instance family and for each solver we firstly compare the 33 con- 
figurations resulting from the NOLH analysis, obtaining the best parameter 
configuration for each solver. Then, for each instance family, we compare 
the three solvers using their best configuration by means of the Wilcoxon 
rank-sum test. 

Table [3] reports, for each family, the best solver, along with its best con- 
figuration. There are cases in which the difference between solvers or con- 
figurations is not statistically significant. In these situations, we consider as 
the best the one with minimum average rank. 

In order to get close to the setting of the ITC 2007, for the Full formu- 
lation we use the instances 1-16 for tuning the parameters, and the instances 
17-24 for validation. In fact, for the competition the last 8 instances (Hidden 
Instances) where not given to the participants, but used by the organisers 
for evaluating the solvers submitted. 
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Instance Family 


Solver 


To 


P 


ITC 2007 

Lewis & Paechter 

Big 

ITC 2002 

Metaheuristics Network 


SA(I , ME - © SE) 
SA(I , ME © SE) 
SA(I , ME © SE) 
SA(/i,ME-eSE) 
SA(I , ME © SE) 


20.41 
31.62 
36.30 
3.89 
3.89 


33.88 
257.63 
295.12 
31.62 
31.62 



Table 3: Best settings of the SA equipped solvers. 



5.3. Comparison with Best Known Results 

We now compare the solvers emerged from the tuning phase (Table [3]) 
with the best results in the literature. Table H] summarises the solvers with 
which we compare. For each solver, we report the reference, the techniques 
used and the family of instances it solves. Notice that no solver previously 
presented in the literature has dealt with more than one family of instances. 

5.3.1. ITC 2007 instances 

We first consider the ITC 2007 instances. Table reports the values 
obtained by our method in 30 runs for instances 1-16, along with a compar- 
ison with respect to the available results reported in the literature (in bold 
the best results). The presence of the dash symbol means that no feasible 
solution has been found. 

The columns %Feas show the percentage of feasible solutions obtained. 
Notice that, for solver D, the paper in some cases reports only that this 
percentage is greater than 95%, instead of the precise value (it reports instead 
the average number of violations). 

The average values are computed considering all the solutions obtained 
in the experiments, including the infeasible ones. Obviously, the value of the 
objective function for the infeasible solutions is not very meaningful. How- 
ever, for our solver the number of infeasible solutions is very small, therefore 
the average of the value of the objective function is still the most meaningful 
index. 

For instances 17-24, values are not reported in the cited papers (except for 
van den Broek and Hurkens . 2010l ). therefore we compare our solver with the 



results extracted from the spreadsheet available from the ITC 2007 website. 
As mentioned above, our results on these instances are obtained with the 
best parameter configuration used for instances 1-16. 

From the results it is possible to see that our method outperform s all 



other solvers on 9 out of 24 instances, it is second to lCambazard et alJ on 11 



instances, and second to iMayer et al.l in the remaining 4. 



This positive result is confirmed by applying the ranking method of ITC 
2007. The first row of Table [6] shows the average of the ranks obtained by 
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Solver 


Reference 


Technique 


Family of instances 


A 


Chiarandini et al. ( 2008) 


Local Search + Matching 


ITC 2007 


B 


Miiller (2009) 


Constructive + Local Search (HC, GD, SA) 


ITC 2007 


CI 


Cambazard et al. (2010) 


Local Search (SA) 


ITC 2007 


C2 


Cambazard et al. (2010) 


Local Search (SA) 


ITC 2007 


D 


Lewis (20101 


Constructive + Iterated Heuristic + Local Search (SA) 


ITC 2007 


E 


van den Broek and Hurkens (2010) 


Column Generation + ILP 


ITC 2007 


F 


Maver et al. (2008) 


Ant Colony Optimisation 


ITC 2007, ITC 2002 


Gl 


Lewis and Paechter (2007) 


Genetic Algorithm 


Lewis and Paechter 


G2 


Lewis and Paechter (2007) 


Genetic Algorithm 


Lewis and Paechter 


G3 


Lewis and Paechter (2007) 


Genetic Algorithm 


Lewis and Paechter 


H 


Tuea et al. (2007) 


Constructive + Local Search (SA) 


Lewis and Paechter 


I 


Liu et al. (2011) 


Constructive 


Lewis and Paechter 


J 


Burke et al. (2003) 


Local Search (GD) 


ITC 2002 


K 


Di GasDero and Schaerf (2006) 


Local Search 


ITC 2002 


L 


Kostuch (2005) 


Constructive + Local Search (SA) 


ITC 2002 


M 


Chiarandini et al. (2006) 


Constructive + Local Search (TS, SA) 


ITC 2002 


N 


Socha et al. (2002) 


Ant Colony Optimisation 


Metaheuristics Network 





Abdullah et al. (2007) 


Memetic algorithm 


Metaheuristics Network 


P 


McMullan (2007) 


Constructive + Local Search (GD) 


Metaheuristics Network 


Q 


Landa-Silva and Obit (2008) 


Local Search (GD) 


Metaheuristics Network 


R 


Turabieh et al. (2009) 


Local Search (GD) 


Metaheuristics Network 



Table 4: Solvers compared in the experimental phase (HC: Hill Climbing, GD: Great Deluge, SA: Simulated An- 
nealing, TS: Tabu Search.) 



each finalist of the competition (available from the ITC 2007 website), from 
which it results that Cambazard et al. won the competition. Adding a- 
posteriori our solver to the final of the competition^, we obtain the ranks 
of the second row, from which we see that our solver would have won the 
competition. 



5.3.2. Lewis and Paechter instances 



Moving to the lLewis and Paechterl instances, Tables ITal and 1751 report the 
results for the 20 medium and the 20 big instances (we do not report here 
results on the 20 small ones because they are not challenging, given that we 
solve all of th em to optimality in all run s) . 

Following iLewis and Paechterl (120071 ). for these instances in Tables [7] we 
report the number of unscheduled events, rather than t he total number o f 
students attending them. However, the solver, similarly to lTuga et al.l (120071 ). 
still uses the number of students as the distance to feasibility. This version 
of the cost function proved experimentally to be more effective. 

Also for these instances we have been able to obtain new best results 
and to be relatively close to the best known results in all the other cases. It 
is worth mentioning that these instances have very different structure with 
respect to the other data sets, and in these cases it is not always possible to 
find a feasible solution. Indeed, the authors who considered these instances 
used ad hoc techniques, which are rather different from those used by the 
authors who worked on the other instance families. 

5.3.3. ITC 2002 instances 

The results of the experiments on the ITC 2002 in stances are re ported in 
Table [HJ Unfortunately, for all papers but the one by iMayer et al.l only best 
results are available from the literature, therefore a fair comparis on is not 
possible. Nevertheless, it is clear from the table tha t the results of iKostuch 
are the overall bests. Regarding the comparison with lMayer et al 
clearly outperforms their one in all 20 cases. 



our solver 



5.3.4- Metaheuristics Network instances 

We finally move the the Metaheuristics Network instances, which have 
been tackled by yet different authors. For these instances, our solver greatly 
outperforms all the others on all the medium-size (ml-m5) and on the first 
large instance (11), while it is only marginally inferior on the small ones. 
Instance 12 has not been tested recently in the literature (because of the use 
of an incomplete copy of the dataset). 



1 Using the spreadsheet downloaded from the ITC 2007 website. 
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Inst. 


A 

Best 


B 

Best 


Avg 


CI 

%Feas 


Best 


Avg 


C2 

07 "n 

%Feas 


Best 


Med 


D 

07 i ' 

%Feas 


Best 


E 
Best 


Avg 


F 

07 1 n 

/oFeas 


Best 


Avg 


Us 

07 ~n 

%Feas 


Best 


1 


925 


1330 


830 


100 


358 


547 


100 


15 


1492 


45 


1294 


1636 


613 


54 





399.2 


100 


59 


2 


1156 


2154 


924 


100 


11 


403 


100 


356 


1826 


22 


1599 


1634 


556 


59 





142.2 


100 





3 


179 


205 


224 


100 


156 


254 


100 


174 


457 


> 95 


278 


355 


680 


100 


110 


209.9 


100 


148 


4 


66 


394 


352 


100 


61 


361 


100 


249 


589 


> 95 


388 


644 


580 


100 


53 


349.6 


100 


25 


5 


52 





3 


100 





26 


100 





193 


> 95 


22 


525 


92 


100 


13 


7.7 


100 





6 


536 


13 


14 


100 





16 


100 





689 


> 95 


369 


640 


212 


95 





8.6 


100 





7 


7 


5 


11 


100 


5 


8 


100 


1 


421 


> 95 


74 





4 


100 





4.9 


100 





8 











100 








100 





206 


100 





241 


61 


100 





1.5 


100 





9 


1480 


1895 


1649 


100 


1049 


1167 


100 


29 


2312 


2 


1482 


1889 


202 


85 





258.8 


97 





1 A 
11) 


1 OCJ/I 

loo4 




2003 


no 


770 


129 I 


o n 


o 

I 


2262 


o 

I 


2380 


Io77 


4 


100 





186.4 


n ~ 

'■ :) I 


■J 

3 


1 1 
1 1 


100 


/ 


311 


100 


157 


361 


100 


178 


541 


> 95 


344 


010 


774 


99 


143 


269.5 


100 


142 


12 


1 


453 


408 


100 





380 


100 


14 


741 


> 95 


486 


528 


538 


86 





400.0 


100 


267 


13 


360 


74 


89 


100 





135 


100 





631 


> 95 


365 


485 


360 


94 


5 


120.0 


100 


1 


14 


576 


2 


1 


100 





15 


100 





660 


> 95 


222 


739 


41 


100 





3.6 


100 





15 








80 


100 





47 


100 





344 


> 95 


266 


330 


29 


100 





48.0 


100 





16 





6 


19 


100 


1 


58 


100 


1 


194 


> 95 


99 


260 


101 


100 





50.1 


100 





Avg 






432.4 


317.2 


847.4 




302.9 


153.7 



(a) Public instances 





A 






B 






CI 




E 




F 






Us 




Inst. 


Avg 


Best 


Avg 


%Feas 


Best 


Avg 


%Feas 


Best 


Best 


Avg 


%Feas 


Best 


Avg 


%Feas 


Best 


17 


9.8 


5 


106.2 


100 


72 


4.9 


100 





35 


116.4 


100 


68 


0.0 


100 





18 


339.9 


3 


314.3 


100 


70 


14.1 


100 





503 


264.8 


100 


26 


41.1 


100 





19 


2080.8 


1869 


2314.0 







2027.0 


20 


1824 


963 


233.1 


90 


22 


951.5 


74 





20 


640.5 


596 


919.3 


100 


878 


505.0 


100 


445 


1229 









700.2 


100 


543 


21 


876.3 


602 


336.8 


100 


40 


27.1 


100 





670 


326.6 


80 


33 


35.9 


97 


5 


22 


1839.2 


1364 


1593.7 


60 


889 


550.8 


90 


29 


1956 


82.7 


100 





19.9 


100 


5 


23 


1043.4 


688 


701.3 


100 


436 


330.5 


100 


238 


2368 









1707.7 


20 


1292 


24 


963.4 


822 


518.0 


100 


372 


124.2 


100 


21 


945 


129.2 


100 


30 


105.3 


100 





Avg 


974.2 


850.5 


448.0 






445.2 



(b) Hidden instances (results taken from the spreadsheet on the ITC 2007 website) 



Table 5: Results on ITC 2007 instances for 30 runs. 



Atsuta et al. 


CI 


A 


F 


B 


Us 


24.43 


13.90 


28.34 


29.52 


31.31 




31.41 


19.98 


36.85 


37.33 


40.70 


16.73 



Table 6: Comparison using the ITC 2007 ranking system. 



6. Discussion, Conclusions, and Future Work 

We have presented a Simulated Annealing approach for a classical well- 
studied timetabling problem, namely the PE-CTT problem. The comprehen- 
sive comparison with the literature shows that our solver is able to outper- 
form most of the previous approaches to the problem. This result is obtained 
despite the fact that our solution is based on a relatively simple single-step 
algorithm, whereas most of the previous solvers use complex multi-step solu- 
tion methods. In addition, the method proved to be quite robust w.r.t. the 
parameter values. 

In our opinion, the key ingredients for these good results are the following. 
First of all, the preprocessing and constraint reformulation steps improve the 
efficacy of the local search. In particular, the identification of the all-room 
events allows us to leave more space for placing the other events. Secondly, 
the room assignment procedure based on attractiveness allows us to refrain 
from using the matching algorithm, which is computationally expensive. Fi- 
nally, the use of a single-step procedure that takes into account the soft 
constraints from the very beginning allowed us to save computational time 
later on during the search. 

Only for the ITC 2002 instances the results are inferior to the best ones 
reported in the literature. Unfortunately, the reliability of this comparison is 
limited since it is based only on the best results found by the other authors. 

For the future, we plan to extend our work in various directions: 

1. Investigate on the use of different versions of Simulated Annealing, for 
example using different cooling schemes and acceptance criteria. 

2. Improve our use of the tuning tools, mainly NOLHs and RACE, with 
the twofold objective of making them more effective and to automatise 
part of the experimental process. 

3. Apply the same technique in different contexts, such as CB-CTT and 
other timetabling problems, in order to have a confirmation of its ap- 
plicability. 

4. A nalyse the relevant f eature s of the problem instances, in the spirit 



of iKostuch and Sochal ( 120041 ) : ISmith-Miles and Lopes! (1201 if ), with the 



aim of obtaining an adaptive tuning. The idea would be to set the 
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Gl 


G2 


G3 


H 




I 




Us 




Inst. 


Best 


Best 


Best 


Avg 


Best 


Avg 


Best 


Avg 


Best 


Ml 











0.00 





0.00 





0.00 





M2 











0.00 





0.00 





0.00 





M3 











0.00 





0.00 





0.00 





M4 











0.00 





0.00 





0.00 





M5 


8 








0.00 





0.00 





0.00 





M6 


15 








0.00 





0.00 





0.90 





M7 


41 


34 


14 


4.15 


1 


3.55 





0.00 





M8 


21 


9 





0.00 





0.00 





0.30 





M9 


30 


17 


2 


4.90 





2.15 





0.35 





M10 











0.00 





0.00 





0.00 





Mil 


12 








0.00 





0.00 





0.00 





M12 











0.00 





0.00 





0.60 





M13 


23 


3 





0.50 





0.00 





0.00 





M14 











0.00 





0.00 





0.05 





M15 


10 








0.05 





0.00 





0.00 





M16 


50 


30 


1 


5.15 


1 


0.30 





0.00 





M17 


21 








0.00 





0.00 





0.15 





M18 


15 








6.05 





0.00 





0.30 





M19 


51 








5.45 





0.00 





0.50 





M20 


15 





3 


10.60 


2 


0.65 





0.55 





Avg 








1.84 


0.33 


0.19 



(a) Medium instances 





Gl 


G2 


G3 


H 




I 




Us 




Inst. 


Best 


Best 


Best 


Avg 


Best 


Avg 


Best 


Avg 


Best 


Bl 











0.00 





0.00 





0.15 





B2 











0.00 





0.00 





0.60 





B3 











0.00 





0.00 





1.45 





B4 


32 


30 


8 


0.00 





0.00 





0.00 





B5 


31 


24 


30 


1.10 





3.20 


1 


0.00 





B6 


90 


71 


77 


8.45 


5 


15.40 


10 


2.85 


1 


B7 


150 


145 


150 


58.30 


47 


46.65 


39 


29.25 


21 


B8 


35 


30 


5 


0.00 





0.00 





0.00 





B9 


26 


18 


3 


0.05 





0.00 





0.00 





BIO 


36 


32 


24 


1.25 





1.95 





0.00 





Bll 


43 


37 


22 


0.35 





2.35 





0.00 





B12 


4 








0.00 





0.00 





1.15 





B13 


23 


10 





0.00 





0.00 





1.15 





B14 


8 








0.00 





0.00 





1.20 





B15 


120 


98 





0.00 





0.00 





3.50 


1 


B16 


120 


100 


19 


2.00 





0.00 





0.65 





B17 


260 


243 


163 


89.90 


76 


2.05 





22.00 


12 


B18 


199 


173 


164 


62.60 


53 


1.70 





13.55 


8 


B19 


262 


253 


232 


127.00 


109 


53.20 


40 


52.85 


37 


B20 


186 


165 


149 


46.70 


40 


14.05 


9 


15.05 


11 


Avg 








19.89 


7.03 


7.27 



(b) Big instances 



Table 7: Results on Lewis and Paechter instances of for 20 runs 
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J 


K 


L 


M 


F 




Us 




Inst. 


Best 


Best 


Best 


Best 


Avg 


Best 


Avg 


Best 


1 


85 


63 


16 


45 


82 


55 


57.05 


45 


2 


42 


46 


2 


14 


64 


43 


33.20 


20 


3 


84 


96 


17 


45 


92 


61 


53.20 


43 


4 


119 


166 


34 


71 


208 


134 


109.90 


87 


5 


77 


203 


42 


59 


185 


134 


91.70 


71 


6 


6 


92 





1 


59 


32 


14.05 


2 


7 


12 


118 


2 


3 


138 


52 


13.70 


2 


8 


32 


66 





1 


107 


48 


20.00 


9 


9 


184 


51 


1 


8 


70 


39 


21.90 


15 


10 


90 


81 


21 


52 


118 


77 


60.70 


41 


11 


73 


65 


5 


30 


75 


39 


38.20 


24 


12 


79 


119 


55 


75 


143 


102 


83.65 


62 


13 


91 


160 


31 


55 


156 


94 


77.95 


59 


14 


36 


197 


11 


18 


175 


109 


34.20 


21 


15 


27 


114 


2 


8 


89 


47 


11.80 


6 


16 


300 


38 





55 


45 


26 


16.70 


6 


17 


79 


212 


37 


46 


143 


78 


56.45 


42 


18 


39 


40 


4 


24 


59 


35 


25.85 


11 


19 


86 


185 


7 


33 


187 


119 


72.95 


56 


20 





17 








38 


19 


1.75 





Avg 










111.65 


44.75 



Table 8: Results on ITC 2002 instances for 20 runs. 



specific parameters based on the analysis of the specific instance, and 
the extraction of the values of specific features. 
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N 







P 




Q 


R 


Us 
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Med 
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si 
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s2 
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s3 
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s4 
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0.2 

















ml 
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80 
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9 
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15 
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529 


834.1 


730 


876 


912 


259.8 


208 


Avg 




134.82 


131.66 






35.99 


12 














224.4 


170 



Table 9: Results on instances of the Metaheuristics Network for 30 runs. 



Burke, E., Bykov, Y., Newall, J., Petrovic, S., 2003. A time-predefined ap- 
proach to course timetabling. Yugoslav Journal of Operations Research 
13 (2), 139-151. 

Burke, E., Marecek, J., Parkes, A., Rudova, H., 2010. A supernodal formu- 
lation of vertex colouring with applications in course timetabling. Annals 
of Operations Research 179 (1), 105-130. 

Burke, E. K., Petrovic, S., 2002. Recent research directions in automated 
timetabling. European Journal of Operational Research 140 (2), 266-280. 

Cambazard, H., Hebrard, E., O'Sullivan, B., Papadopoulos, A., 2010. Local 
search and constraint programming for the post enrolment-based course 
timetabling problem. Annals of Operations Research, 1-25. 
URL [http : //dx . doi . org/10 . 1007/sl0479-010-0737-"7] 



Chiarandini, M., Birattari, M., Socha, K., Rossi-Doria, O., 2006. An effective 
hybrid approach for the university course timetabling problem. Journal of 
Scheduling 9 (5), 403-432. 

Chiarandini, M., Fawcett, C, Hoos, H., 2008. A modular multiphase heuris- 
tic solver for post enrolment course timetabling. In: Burke, E., Gendreau, 
M. (Eds.), Proc. of the 7th Int. Conf. on the Practice and Theory of Au- 
tomated Timetabling (PATAT-2008). pp. 1-6. 

Cioppa, T. M., Lucas, T. W., 2007. Efficient nearly orthogonal and space- 
filling latin hypercubes. Technometrics 49 (1), 45-55. 



21 



de Werra, D., 1985. An introduction to timetabling. European Journal of 
Operational Research 19, 151-162. 



Di Gaspero, L., Schaerf, A., 2003. EasyLocal++: An object-oriented 
framework for flexible design of local search algorithms. Software — Practice 
and Experience 33 (8), 733-765. 

Di Gaspero, L., Schaerf, A., 2006. Neighborhood portfolio approach for local 
search applied to timetabling problems. Journal of Mathematical Modeling 
and Algorithms 5 (1), 65-89. 

Eglese, R. W., 1990. Simulated annealing: a tool for operational research. 
European Journal of Operational Research 46, 271-281. 

Gotlieb, C. C, 1963. The construction of class-teacher timetables. In: Pop- 
plewell, C. M. (Ed.), IFIP congress 62. North-Holland, pp. 73-77. 

Hao, J.-K., Benlic, U., 2011. Lower bounds for the ITC-2007 curriculum- 
based course timetabling problem. European Journal of Operational Re- 
search. 



URL |http : //dx . doi . org/10 . 1016/ j . e j or . 2011 . 02 . 019 



Hertz, A., 1991. Tabu search for large scale timetabling problems. European 
Journal of Operational Research 54, 39-47. 

Hertz, A., 1992. Finding a feasible course schedule using tabu search. Discrete 
Applied Mathematics 35 (3), 255-270. 

Hoos, H. H., Stiitzle, T., 2005. Stochastic Local Search - Foundations and 
Applications. Morgan Kaufmann Publishers, San Francisco, CA (USA). 

Hutter, F., Hoos, H., Leyton-Brown, K., Stiitzle, T., 2009. ParamlLS: An 
automatic algorithm configuration framework. Journal of Artificial Intelli- 
gence Research 36, 267-306. 

Johnson, D. S., 2002. A theoretician's guide to the experimental analysis 
of algorithms. In: Goldwasser, M. H., Johnson, D. S., McGeoch, C. C. 
(Eds.), Data Structures, Near Neighbor Searches, and Methodology: Fifth 
and Sixth DIMACS Implementation Challenges. American Mathematical 
Society, pp. 215-250. 



URL http: //www. research. att . com/ ~dsj /papers .html 



Kirkpatrick, S., Gelatt, Jr, C. D., Vecchi, M. P., 1983. Optimization by 
simulated annealing. Science 220, 671-680. 



22 



Kostuch, P., 2005. The university course timetabling problem with a three- 
phase approach. In: Burke, E., Trick, M. (Eds.), Proc. of the 5th Int. 
Conf. on the Practice and Theory of Automated Timetabling (PATAT- 
2004), selected papers. Vol. 3616 of Lecture Notes in Computer Science. 
Springer- Verlag, Berlin-Heidelberg, pp. 109-125. 

Kostuch, P., Socha, K., 2004. Hardness prediction for the university course 
timetabling problem. In: Gottlieb, J., Raidl, G. R. (Eds.), Evolutionary 
Computation in Combinatorial Optimization. Vol. 3004 of Lecture Notes 
in Computer Science. Springer Berlin / Heidelberg, pp. 135-144. 

Lach, G., Liibbecke, M., 2011. Curriculum based course timetabling: Op- 
timal solutions to the udine benchmark instances. Annals of Operations 
Research, 1-18. 



URL http : //dx . doi . org/10 . 1007/sl0479-Q10-0700-7 



Landa-Silva, D., Obit, J. H., September 2008. Great deluge with non-linear 
decay rate for solving course timetabling problems. In: 2008 4th Interna- 
tional IEEE Conference Intelligent Systems, pp. 8-18. 

Lewis, R., 2008. A survey of metaheuristic-based techniques for university 
timetabling problems. OR Spectrum 30 (1), 167-190. 

Lewis, R., 2010. A time-dependent metaheuristic algorithm for post 
enrolment-based course timetabling. Annals of Operations Research, 1- 
17. 



URL http : //dx . doi . org/10 . 1007/sl0479-010-0696-z 



Lewis, R., Paechter, B., 2005. Application of the grouping genetic algorithm 
to university course timetabling. In: Raidl, G., Gottlieb, J. (Eds.), Fifth 
International Conference on Evolutionary Computation in Combinatorial 
Optimisation (EvoCop 2005). No. 3448 in LNCS. Springer, pp. 144-153. 

Lewis, R., Paechter, B., 2007. Finding feasible timetables using group-based 
operators. IEEE Transactions on Evolutionary Computation 11 (3), 397- 
413. 

Lewis, R., Paechter, B., McCollum, B., 2007. Post enrolment based course 
timetabling: A description of the problem model used for track two of the 
second international timetabling competition. Tech. rep., Cardiff Univer- 
sity, Wales, UK. 

Liu, Y., Zhang, D., Chin, F., 2011. A clique-based algorithm for constructing 
feasible timetables. Optimization Methods and Software 26 (2), 281-294. 



23 



Lii, Z., Hao, J.-K., 2009. Adaptive tabu search for course timetabling. Euro- 
pean Journal of Operational Research 200 (1), 235 - 244. 



Mayer, A., Nothegger, C, Chwatal, A., Raidl, G., 2008. Solving the post en- 
rolment course timetabling problem by ant colony optimization. In: Burke, 
E., Gendreau, M. (Eds.), Proc. of the 7th Int. Conf. on the Practice and 
Theory of Automated Timetabling (PATAT-2008). pp. 1-13. 

McCollum, B., Schaerf, A., Paechter, B., McMullan, P., Lewis, R., Parkes, 
A. J., Di Gaspero, L., Qu, R., , Burke, E. K., 2010. Setting the research 
agenda in automated timetabling: The second international timetabling 
competition. INFORMS Journal on Computing 22 (1), 120-130. 

McMullan, P., 2007. An Extended Implementation of the Great Deluge Al- 
gorithm for Course Timetabling. Computational Science-ICCS 2007, 538 
- 545. 

Miiller, T., 2009. ITC2007 solver description: a hybrid approach. Annals of 
Operations Research 172 (1), 429-446. 

Murray, K. S., Miiller, T., Rudova, H., 2007. Modeling and solution of a 
complex university course timetabling problem. In: Proc. of the 6th Int. 
Conf. on the Practice and Theory of Automated Timetabling (PATAT- 
2006), selected papers, pp. 189-209. 

Rossi-Doria, O., et al., 2003. A comparison of the performance of different 
metaherustic on the timetabling problem. In: Burke, E., De Causmaecker, 
P. (Eds.), Proc. of the 4th Int. Conf. on the Practice and Theory of Auto- 
mated Timetabling (PATAT-2002), selected papers. Vol. 2740 of Lecture 
Notes in Computer Science. Springer- Verlag, Berlin-Heidelberg, pp. 329- 
351. 

Sanchez, S. M., 2005. NOLH designs spreeadsheet. Visited on April 6, 2011. 



URL http://diana. cs .nps .navy .mil/SeedLab/ 



Schaerf, A., 1999. A survey of automated timetabling. Artificial Intelligence 
Review 13 (2), 87-127. 

Smith-Miles, K. A., Lopes, L., 2011. Generalising algorithm performance in 
instance space: A timetabling case study. In: Proceedings of Learning and 
Intelligent Optimization (LION 2011). pp. 1-15. 



24 



Socha, K., Knowles, J., Sampels, M., 2002. A MAX-MIN ant system for the 
university timetabling problem. In: Proc. of the 3rd International Work- 
shop on Ant Algorithms (ANTS 2002). Vol. 2463 of Lecture Notes in Com- 
puter Science. Springer- Verlag, Berlin, Germany, pp. 1-13. 

Tuga, M., Berretta, R., Mendes, A., 2007. A hybrid simulated annealing 
with kempe chain neighborhood for the university timetabling problem. In: 
6th IEEE/ACIS International Conference on Computer and Information 
Science (ICIS 2007). pp. 400 - 405. 

Turabieh, H., Abdullah, S., McCollum, B., 2009. Electromagnetism- 
like Mechanism with Force Decay Rate Great Deluge for the Course 
Timetabling Problem. Lecture Notes In Artificial Intelligence; Vol. 5589, 
497. 

van den Broek, J. J. J., Hurkens, C. A. J., 2010. An IP-based heuristic for 
the post enrolment course timetabling problem of the ITC2007. Annals of 
Operations Research, 1-16. 



URL http : //dx . doi . org/10 . 1007/sl0479-010-0708-z 



25 



